On the impact of on-road partially-automated driving on drivers' cognitive workload and attention allocation.

The use of partially-automated or SAE level-2 vehicles is expected to change the role of the human driver from operator to supervisor, which may have an effect on the driver's workload and visual attention. In this study, 30 Ontario drivers operated a vehicle in manual and partially-automated mode. Cognitive workload was measured by means of the Detection Response Task, and visual attention was measured by means of coding glances on and off the forward roadway. No difference in cognitive workload was found between driving modes. However, drivers spent less time glancing at the forward roadway, and more time glancing at the vehicle's touchscreen. These data add to our knowledge of how vehicle automation affects cognitive workload and attention allocation, and show potential safety risks associated with the adoption of partially-automated driving.

The monitoring requests on young driver's fatigue and take-over performance in prolonged conditional automated driving.

INTRODUCTION: L3 automated vehicles can perform all dynamic driving tasks unless a take-over occurs due to operational limits. This issue is potentially important for young drivers who are vulnerable road users since they have skill deficits and easily evolve into aberrant driving. However, drivers lacking active involvement may be fatigued and drowsy. Previous research indicated that performing a voluntary non-driving-related task (NDRT) could keep drivers alert, but there was no difference in take-over performance with or without NDRT. Providing a monitoring request (MR) before a possible take-over request (TOR) exhibited better take-over performance in temporary automated driving. Therefore, the study aimed to investigate the effects of MR and voluntary NDRT on young drivers' fatigue and performance. METHOD: Twenty-five young drivers experienced 60 min automated driving on a highway with low traffic density and a TOR prompted due to a collision event. A within-subjects was designed that comprised three conditions: NONE, TOR-only, and MR + TOR. Drivers were allowed to perform a self-paced phone NDRT during automated driving. RESULTS: The PERCLOS and blink frequency data showed that playing phones could keep drivers vigilant. The take-over performance on whether taking phone had no difference, but with MRs condition exhibited better take-over performance including the shorter reaction time and the longer TTC. Subjective evaluations also showed the advantages of MRs with more safety, trust, acceptance, and lower workload. CONCLUSIONS: Taking MRs had a positive effect on relieving fatigue and improving take-over performance. Furthermore, MRs could potentially improve the safety and acceptance of automated driving. PRACTICAL APPLICATIONS: The MR design can be used in the automotive industry to ensure the safest interfaces between fatigue drivers and automation systems.

A survey on 3D object detection in real time for autonomous driving.

This survey reviews advances in 3D object detection approaches for autonomous driving. A brief introduction to 2D object detection is first discussed and drawbacks of the existing methodologies are identified for highly dynamic environments. Subsequently, this paper reviews the state-of-the-art 3D object detection techniques that utilizes monocular and stereo vision for reliable detection in urban settings. Based on depth inference basis, learning schemes, and internal representation, this work presents a method taxonomy of three classes: model-based and geometrically constrained approaches, end-to-end learning methodologies, and hybrid methods. There is highlighted segment for current trend of multi-view detectors as end-to-end methods due to their boosted robustness. Detectors from the last two kinds were specially selected to exploit the autonomous driving context in terms of geometry, scene content and instances distribution. To prove the effectiveness of each method, 3D object detection datasets for autonomous vehicles are described with their unique features, e. g., varying weather conditions, multi-modality, multi camera perspective and their respective metrics associated to different difficulty categories. In addition, we included multi-modal visual datasets, i. e., V2X that may tackle the problems of single-view occlusion. Finally, the current research trends in object detection are summarized, followed by a discussion on possible scope for future research in this domain.

Test procedure for the evaluation of partially automated driving HMI including driver monitoring systems in driving simulation.

The proposed test procedure presents an approach for the evaluation of the usability of partial automated driving HMI including driver monitoring systems in driving simulation. This procedure is based on a definition of requirements that a Level 2 HMI and its included driver monitoring system must fulfill in order to guarantee that the drivers understand their responsibilities of continuously monitoring the driving environment and the status of the partial automated driving system. These requirements are used to define the evaluation criteria that have to be validated in the test as well as the use cases in which these criteria can be assessed. The result is a detailed and comprehensive test guide including the specification of the test drives, the necessary instructions, the test environment and the recruiting criteria for the test sample.•Evaluation of usability aspects of level 2 automated driving HMI including driver monitoring systems•Based on the definition of requirements for L2 HMI•Test guide including the definition of use cases, evaluation criteria and testing conditions in driving simulation.

Personalizing automated driving speed to enhance user experience and performance in intermediate-level automated driving.

In the context of high-level driving automation (SAE levels 4-5), several studies have shown that a personalized automated driving style, i.e., mimicking that of the human behind the wheel, can improve his experience. The objective of this simulator study was to examine the potential transfer of these benefits in the context of intermediate-level driving automation (SAE levels 2-3), focusing on driving speed personalization. In the first phase of the study, the driving speed of 52 participants was recorded. In the second phase, the same participants were driven by an automated car on a highway twice, and sometimes had to takeover during the drive because of a stationary vehicle on the lane. On these two drives, the automated car drove either at the same speed as them (personalized) or 20 km/h faster. The results showed that using a personalized speed driving style led to higher comfort, and that this effect was fully mediated by automated driving perceived safety. Although driving speed predicted automated driving perceived safety, this effect was actually moderated by trust in automated cars. Regarding takeover performance, the results showed that the brake use and maximum force were lower with the personalized speed driving style, leading to lower resulting maximum negative longitudinal acceleration and speed variability. Overall, the results of this study suggest that the benefits of automated driving style personalization in terms of speed extend to SAE levels 2-3. In addition to the experience benefits, this personalization approach could also improve traffic flow and safety.

The effects of various auditory takeover requests: A simulated driving study considering the modality of non-driving-related tasks.

With the era of automated driving approaching, designing an effective auditory takeover request (TOR) is critical to ensure automated driving safety. The present study investigated the effects of speech-based (speech and spearcon) and non-speech-based (earcon and auditory icon) TORs on takeover performance and subjective preferences. The potential impact of the non-driving-related task (NDRT) modality on auditory TORs was considered. Thirty-two participants were recruited in the present study and assigned to two groups, with one group performing the visual N-back task and another performing the auditory N-back task during automated driving. They were required to complete four simulated driving blocks corresponding to four auditory TOR types. The earcon TOR was found to be the most suitable for alerting drivers to return to the control loop because of its advantageous takeover time, lane change time, and minimum time to collision. Although participants preferred the speech TOR, it led to relatively poor takeover performance. In addition, the auditory NDRT was found to have a detrimental impact on auditory TORs. When drivers were engaged in the auditory NDRT, the takeover time and lane change time advantages of earcon TORs no longer existed. These findings highlight the importance of considering the influence of auditory NDRTs when designing an auditory takeover interface. The present study also has some practical implications for researchers and designers when designing an auditory takeover system in automated vehicles.

Investigating mental workload caused by NDRTs in highly automated driving with deep learning.

OBJECTIVE: This study aimed to examine the impact of non-driving-related tasks (NDRTs) on drivers in highly automated driving scenarios and sought to develop a deep learning model for classifying mental workload using electroencephalography (EEG) signals. METHODS: The experiment involved recruiting 28 participants who engaged in simulations within a driving simulator while exposed to 4 distinct NDRTs: (1) reading, (2) listening to radio news, (3) watching videos, and (4) texting. EEG data collected during NDRTs were categorized into 3 levels of mental workload, high, medium, and low, based on the NASA Task Load Index (NASA-TLX) scores. Two deep learning methods, namely, long short-term memory (LSTM) and bidirectional long short-term memory (BLSTM), were employed to develop the classification model. RESULTS: A series of correlation analyses revealed that the channels and frequency bands are linearly correlated with mental workload. The comparative analysis of classification results demonstrates that EEG data featuring significantly correlated frequency bands exhibit superior classification accuracy compared to the raw EEG data. CONCLUSIONS: This research offers a reference for assessing mental workload resulting from NDRTs in the context of highly automated driving. Additionally, it delves into the development of deep learning classifiers for EEG signals with heightened accuracy.

Driver behavior and mental workload for takeover safety in automated driving: ACT-R prediction modeling approach.

OBJECTIVE: Conditional automated driving (SAE level 3) requires the driver to take over the vehicle if the automated system fails. The mental workload that can occur in these takeover situations is an important human factor that can directly affect driver behavior and safety, so it is important to predict it. Therefore, this study introduces a method to predict mental workload during takeover situations in automated driving, using the ACT-R (Adaptive Control of Thought-Rational) cognitive architecture. The mental workload prediction model proposed in this study is a computational model that can become the basis for emerging crash avoidance technologies in future autonomous driving situations. METHODS: The methodology incorporates the ACT-R cognitive architecture, known for its robustness in modeling cognitive processes and predicting performance. The proposed takeover cognitive model includes the symbolic structure for repeatedly checking the driving situation and performing decision-making for takeover as well as Non-Driving-Related Tasks (NDRT). We employed the ACT-R cognitive model to predict mental workload during takeover in automated driving scenarios. The model's predictions are validated against physiological data and performance data from the validation test. RESULTS: The model demonstrated high accuracy, with an r-square value of 0.97, indicating a strong correlation between the predicted and actual mental workload. It successfully captured the nuances of multitasking in driving scenarios, showcasing the model's adaptability in representing diverse cognitive demands during takeover. CONCLUSIONS: The study confirms the efficacy of the ACT-R model in predicting mental workload for takeover scenarios in automated driving. It underscores the model's potential in improving driver-assistance systems, enhancing vehicle safety, and ensuring the efficient integration of human-machine roles. The research contributes significantly to the field of cognitive modeling, providing robust predictions and insights into human behavior in automated driving tasks.

Lateral Evasive Maneuver with Shared Control Algorithm: A Simulator Study.

Shared control algorithms have emerged as a promising approach for enabling real-time driver automated system cooperation in automated vehicles. These algorithms allow human drivers to actively participate in the driving process while receiving continuous assistance from the automated system in specific scenarios. However, despite the theoretical benefits being analyzed in various works, further demonstrations of the effectiveness and user acceptance of these approaches in real-world scenarios are required due to the involvement of the human driver in the control loop. Given this perspective, this paper presents and analyzes the results of a simulator-based study conducted to evaluate a shared control algorithm for a critical lateral maneuver. The maneuver involves the automated system helping to avoid an oncoming motorcycle that enters the vehicle's lane. The study's goal is to assess the algorithm's performance, safety, and user acceptance within this specific scenario. For this purpose, objective measures, such as collision avoidance and lane departure prevention, as well as subjective measures related to the driver's sense of safety and comfort are studied. In addition, three levels of assistance (gentle, intermediate, and aggressive) are tested in two driver state conditions (focused and distracted). The findings have important implications for the development and execution of shared control algorithms, paving the way for their incorporation into actual vehicles.

Effect of a looming visual cue on situation awareness and perceived urgency in response to a takeover request.

This study aimed to investigate the effect of a looming visual cue on situation awareness and perceived urgency in response to a takeover request (TOR), and to explore the underlying mechanisms of this effect through three experiments. In Experiment 1, the optimal size and speed of a red disk were determined, which were effective in capturing looming motion and conveying the urgency of the situation. The results indicated that both looming speed and size ratio had significant effects on situation awareness and perceived urgency. In Experiment 2, the effects of looming stimuli were compared with dimming stimuli, and the results showed that the looming visual cue was more effective in promoting perceived urgency and situation awareness. The results also indicated that the looming visual cue attracted more visual attention than the dimming visual cue, in line with previous studies. Experiment 3 utilized a driving simulator to test the effectiveness of the looming visual cue in promoting fast and appropriate responses to TORs in complex driving scenarios. The results showed that the looming visual cue was more effective in promoting perceived urgency and enhancing situation awareness, especially in highly complex driving situations. Overall, the findings suggest that the looming visual cue is a powerful tool for promoting fast and appropriate responses to TORs and enhancing situation awareness, particularly in complex driving scenarios. These results have important implications for designing effective TOR systems and improving driver safety on the road.

The Impact of Line-of-Sight and Connected Vehicle Technology on Mitigating and Preventing Crash and Near-Crash Events.

Line-of-sight (LOS) sensors developed in newer vehicles have the potential to help avoid crash and near-crash scenarios with advanced driving-assistance systems; furthermore, connected vehicle technologies (CVT) also have a promising role in advancing vehicle safety. This study used crash and near-crash events from the Second Strategic Highway Research Program Naturalistic Driving Study (SHRP2 NDS) to reconstruct crash events so that the applicable benefit of sensors in LOS systems and CVT can be compared. The benefits of CVT over LOS systems include additional reaction time before a predicted crash, as well as a lower deceleration value needed to prevent a crash. This work acts as a baseline effort to determine the potential safety benefits of CVT-enabled systems over LOS sensors alone.

Review of Integrated Chassis Control Techniques for Automated Ground Vehicles.

Integrated chassis control systems represent a significant advancement in the dynamics of ground vehicles, aimed at enhancing overall performance, comfort, handling, and stability. As vehicles transition from internal combustion to electric platforms, integrated chassis control systems have evolved to meet the demands of electrification and automation. This paper analyses the overall control structure of automated vehicles with integrated chassis control systems. Integration of longitudinal, lateral, and vertical systems presents complexities due to the overlapping control regions of various subsystems. The presented methodology includes a comprehensive examination of state-of-the-art technologies, focusing on algorithms to manage control actions and prevent interference between subsystems. The results underscore the importance of control allocation to exploit the additional degrees of freedom offered by over-actuated systems. This paper systematically overviews the various control methods applied in integrated chassis control and path tracking. This includes a detailed examination of perception and decision-making, parameter estimation techniques, reference generation strategies, and the hierarchy of controllers, encompassing high-level, middle-level, and low-level control components. By offering this systematic overview, this paper aims to facilitate a deeper understanding of the diverse control methods employed in automated driving with integrated chassis control, providing insights into their applications, strengths, and limitations.

Adopting Stimulus Detection Tasks for Cognitive Workload Assessment: Some Considerations.

OBJECTIVE: This article tackles the issue of correct data interpretation when using stimulus detection tasks for determining the operator's workload. BACKGROUND: Stimulus detection tasks are a relative simple and inexpensive means of measuring the operator's state. While stimulus detection tasks may be better geared to measure conditions of high workload, adopting this approach for the assessment of low workload may be more problematic. METHOD: This mini-review details the use of common stimulus detection tasks and their contributions to the Human Factors practice. It also borrows from the conceptual framework of the inverted-U shape model to discuss the issue of data interpretation. RESULTS: The evidence being discussed here highlights a clear limitation of stimulus detection task paradigms. CONCLUSION: There is an inherent risk in using a unidimensional tool like stimulus detection tasks as the primary source of information for determining the operator's psychophysiological state. APPLICATION: Two recommendations are put forward to Human Factors researchers and practitioners dealing with the interpretation conundrum of dealing with stimulus detection tasks.

Effects of driving style on takeover performance during automated driving: Under the influence of warning system factors.

Driving style has been proposed to be a critical factor in automated driving. However, the role of driving style in the process of taking over during automated driving needs further investigation. The main purpose of this study was to investigate the influence of driving style on takeover performance under the influence of warning system factors. In addition, this study also explored whether the impact of driving style on reaction time varies over time and the role of driving style on a comprehensive takeover quality indicator. Two driving simulation experiments with different takeover request (TOR) designs were conducted. In experiment 1, content warning information was provided in the TOR with different warning stage designs; in experiment 2, countdown warning information was provided in the TOR with different warning stage designs. Sixty-four participants (32 for experiment 1 and 32 for experiment 2) were classified into two groups based on their driving style (i.e., aggressive, or defensive) using the Chinese version of the Multidimensional Driving Style Inventory (the brief MDSI-C). The results suggested that drivers' driving style had significant effects on takeover performance, but the effects were influenced by warning system designs. Specifically, defensive participants performed better takeover performance, i.e., shorter reaction time and cautious vehicle control behaviors, than aggressive participants in most warning conditions. The content and countdown warning information and warning stage design affected the roles of driving style on takeover performance: 1) compared to the one-stage warning design, the two-stage warning design significantly shortened the reaction time of the participants with different driving styles, 2) compared to the countdown warning information design, the design of content warning information can shorten the reaction time of aggressive participants and lengthen the reaction time of defensive participants in the two-stage warning conditions, and 3) compared to the content warning information design, countdown warning information can improve the safe takeover performance of defensive participants. This study provides a better understanding of the role of driving style on takeover performance, and driving style should be considered when designing warning systems for autonomous vehicles.

How Can the Trust-Change Direction be Measured and Identified During Takeover Transitions in Conditionally Automated Driving? Using Physiological Responses and Takeover-Related Factors.

OBJECTIVE: This paper proposes an objective method to measure and identify trust-change directions during takeover transitions (TTs) in conditionally automated vehicles (AVs). BACKGROUND: Takeover requests (TORs) will be recurring events in conditionally automated driving that could undermine trust, and then lead to inappropriate reliance on conditionally AVs, such as misuse and disuse. METHOD: 34 drivers engaged in the non-driving-related task were involved in a sequence of takeover events in a driving simulator. The relationships and effects between drivers' physiological responses, takeover-related factors, and trust-change directions during TTs were explored by the combination of an unsupervised learning algorithm and statistical analyses. Furthermore, different typical machine learning methods were applied to establish recognition models of trust-change directions during TTs based on takeover-related factors and physiological parameters. RESULT: Combining the change values in the subjective trust rating and monitoring behavior before and after takeover can reliably measure trust-change directions during TTs. The statistical analysis results showed that physiological parameters (i.e., skin conductance and heart rate) during TTs are negatively linked with the trust-change directions. And drivers were more likely to increase trust during TTs when they were in longer TOR lead time, with more takeover frequencies, and dealing with the stationary vehicle scenario. More importantly, the F1-score of the random forest (RF) model is nearly 77.3%. CONCLUSION: The features investigated and the RF model developed can identify trust-change directions during TTs accurately. APPLICATION: Those findings can provide additional support for developing trust monitoring systems to mitigate both drivers' overtrust and undertrust in conditionally AVs.

An analysis of physiological responses as indicators of driver takeover readiness in conditionally automated driving.

By the year 2045, it is projected that Autonomous Vehicles (AVs) will make up half of the new vehicle market. Successful adoption of AVs can reduce drivers' stress and fatigue, curb traffic congestion, and improve safety, mobility, and economic efficiency. Due to the limited intelligence in relevant technologies, human-in-the-loop modalities are still necessary to ensure the safety of AVs at current or near future stages, because the vehicles may not be able to handle all emergencies. Therefore, it is important to know the takeover readiness of the drivers to ensure the takeover quality and avoid any potential accidents. To achieve this, a comprehensive understanding of the drivers' physiological states is crucial. However, there is a lack of systematic analysis of the correlation between different human physiological responses and takeover behaviors which could serve as important references for future studies to determine the types of data to use. This paper provides a comprehensive analysis of the effects of takeover behaviors on the common physiological indicators. A program for conditional automation was developed based on a game engine and applied to a driving simulator. The experiment incorporated three types of secondary tasks, three takeover events, and two traffic densities. Brain signals, Skin Conductance Level (SCL), and Heart Rate (HR) of the participants were collected while they were performing the driving simulations. The Frontal Asymmetry Index (FAI) (as an indicator of engagement) and Mental Workload (MWL) were calculated from the brain signals to indicate the mental states of the participants. The results revealed that the FAI of the drivers would slightly decrease after the takeover alerts were issued when they were doing secondary tasks prior to the takeover activities, and the higher difficulty of the secondary tasks could lead to lower overall FAI during the takeover periods. In contrast, The MWL and SCL increased during the takeover periods. The HR also increased rapidly at the beginning of the takeover period but dropped back to a normal level quickly. It was found that a fake takeover alert would lead to lower overall HR, slower increase, and lower peak of SCL during the takeover periods. Moreover, the higher traffic density scenarios were associated with higher MWL, and a more difficult secondary task would lead to higher MWL and HR during the takeover activities. A preliminary discussion of the correlation between the physiological data, takeover scenario, and vehicle data (that relevant to takeover readiness) was then conducted, revealing that although takeover event, SCL, and HR had slightly higher correlations with the maximum acceleration and reaction time, none of them dominated the takeover readiness. In addition, the analysis of the data across different participants was conducted, which emphasized the importance of considering standardization or normalization of the data when they were further used as input features for estimating takeover readiness. Overall, the results presented in this paper offer profound insights into the patterns of physiological data changes during takeover periods. These findings can be used as benchmarks for utilizing these variables as indicators of takeover preparedness and performance in future research endeavors.

Post Take-Over Performance Varies in Drivers of Automated and Connected Vehicle Technology in Near-Miss Scenarios.

OBJECTIVE: This study examined the impact of monitoring instructions when using an automated driving system (ADS) and road obstructions on post take-over performance in near-miss scenarios. BACKGROUND: Past research indicates partial ADS reduces the driver's situation awareness and degrades post take-over performance. Connected vehicle technology may alert drivers to impending hazards in time to safely avoid near-miss events. METHOD: Forty-eight licensed drivers using ADS were randomly assigned to either the active driving or passive driving condition. Participants navigated eight scenarios with or without a visual obstruction in a distributed driving simulator. The experimenter drove the other simulated vehicle to manually cause near-miss events. Participants' mean longitudinal velocity, standard deviation of longitudinal velocity, and mean longitudinal acceleration were measured. RESULTS: Participants in passive ADS group showed greater, and more variable, deceleration rates than those in the active ADS group. Despite a reliable audiovisual warning, participants failed to slow down in the red-light running scenario when the conflict vehicle was occluded. Participant's trust in the automated driving system did not vary between the beginning and end of the experiment. CONCLUSION: Drivers interacting with ADS in a passive manner may continue to show increased and more variable deceleration rates in near-miss scenarios even with reliable connected vehicle technology. Future research may focus on interactive effects of automated and connected driving technologies on drivers' ability to anticipate and safely navigate near-miss scenarios. APPLICATION: Designers of automated and connected vehicle technologies may consider different timing and types of cues to inform the drivers of imminent hazard in high-risk scenarios for near-miss events.

Trust in automated vehicles: constructs, psychological processes, and assessment.

There is a growing body of research on trust in driving automation systems. In this paper, we seek to clarify the way trust is conceptualized, calibrated and measured taking into account issues related to specific levels of driving automation. We find that: (1) experience plays a vital role in trust calibration; (2) experience should be measured not just in terms of distance traveled, but in terms of the range of situations encountered; (3) system malfunctions and recovery from such malfunctions is a fundamental part of this experience. We summarize our findings in a framework describing the dynamics of trust calibration. We observe that methods used to quantify trust often lack objectivity, reliability, and validity, and propose a set of recommendations for researchers seeking to select suitable trust measures for their studies. In conclusion, we argue that the safe deployment of current and future automated vehicles depends on drivers developing appropriate levels of trust. Given the potentially severe consequences of miscalibrated trust, it is essential that drivers incorporate the possibility of new and unexpected driving situations in their mental models of system capabilities. It is vitally important that we develop methods that contribute to this goal.

Velocity Estimation from LiDAR Sensors Motion Distortion Effect.

Many modern automated vehicle sensor systems use light detection and ranging (LiDAR) sensors. The prevailing technology is scanning LiDAR, where a collimated laser beam illuminates objects sequentially point-by-point to capture 3D range data. In current systems, the point clouds from the LiDAR sensors are mainly used for object detection. To estimate the velocity of an object of interest (OoI) in the point cloud, the tracking of the object or sensor data fusion is needed. Scanning LiDAR sensors show the motion distortion effect, which occurs when objects have a relative velocity to the sensor. Often, this effect is filtered, by using sensor data fusion, to use an undistorted point cloud for object detection. In this study, we developed a method using an artificial neural network to estimate an object's velocity and direction of motion in the sensor's field of view (FoV) based on the motion distortion effect without any sensor data fusion. This network was trained and evaluated with a synthetic dataset featuring the motion distortion effect. With the method presented in this paper, one can estimate the velocity and direction of an OoI that moves independently from the sensor from a single point cloud using only one single sensor. The method achieves a root mean squared error (RMSE) of 0.1187 m s-1 and a two-sigma confidence interval of [-0.0008 m s-1, 0.0017 m s-1] for the axis-wise estimation of an object's relative velocity, and an RMSE of 0.0815 m s-1 and a two-sigma confidence interval of [0.0138 m s-1, 0.0170 m s-1] for the estimation of the resultant velocity. The extracted velocity information (4D-LiDAR) is available for motion prediction and object tracking and can lead to more reliable velocity data due to more redundancy for sensor data fusion.

Impact of Partially Automated Driving Functions on Forensic Accident Reconstruction: A Simulator Study on Driver Reaction Behavior in the Event of a Malfunctioning System Behavior.

Partially automated driving functions (SAE Level 2) can control a vehicle's longitudinal and lateral movements. However, taking over the driving task involves automation risks that the driver must manage. In severe accidents, the driver's ability to avoid a collision must be assessed, considering their expected reaction behavior. The primary goal of this study is to generate essential data on driver reaction behavior in case of malfunctions in partially automated driving functions for use in legal affairs. A simulator study with two scenarios involving 32 subjects was conducted for this purpose. The first scenario investigated driver reactions to system limitations during cornering. The results show that none of the subjects could avoid leaving their lane and moving into the oncoming lane and, therefore, could not control the situation safely. Due to partial automation, we could also identify a new part of the reaction time, the hands-on time, which leads to increased steering reaction times of 1.18 to 1.74 s. The second scenario examined driver responses to phantom braking caused by AEBS. We found that 25 of the 32 subjects could not override the phantom braking by pressing the accelerator pedal, although 16 subjects were informed about the system analog to the actual vehicle manuals. Overall, the study suggests that the current legal perspective on vehicle control and the expected driver reaction behavior for accident avoidance should be reconsidered.